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Abstract — The relation between the girth and the error cor- 
rection capability of column-weight-three LDPC codes is inves- 
tigated. Specifically, it is shown that the Gallager A algorithm 
can correct g/2 — 1 errors in g/2 iterations on a Tanner graph 

of girth g > 10. 

Keywords: Low-density parity-check codes, Gallager A algo- 
rithm, error floor, girth 

I. Introduction 

Iterative message passing algorithms for decoding low- 
density parity-check (LDPC) codes [1] operate by passing 
messages along the edges of a graphical representation of the 
code known as the Tanner graph [2]. These algorithms are 
optimal when the underlying graph is a tree (see [3], [4] for 
general theory of LDPC codes), but in the presence of cycles, 
the decoding becomes sub-optimal and there exist low-weight 
patterns known as near codewords [5] or trapping sets [6] 
uncorrectable by the decoder. It is now well established that 
the trapping sets lead to error floor in the high signal-to-noise 
(SNR) region (see [7] for a list of references). While it is 
generally known that high girth codes have better performance 
in the error floor region, the exact relation between the girth 
and the slope of the frame error rate (FER) curve in the error 
floor region is unknown. 

In this paper, we consider transmission over the binary 
symmetric channel (BSC) and the corresponding hard decision 
decoding algorithms. We focus on column-weight-three codes 
which are of special importance as their decoders have very 
low complexity and are interesting for a wide range of 
applications. We show that a column-weight-three LDPC code 
with Tanner graph of girth g > 10 can correct all error patterns 
of weight g/2 — 1 or less under the Gallager A algorithm, 
thereby showing that there are no trapping sets with critical 
number less than g/2 (see [8] pp. 4-6, for missing definitions). 
In [7], we showed that the slope of the FER curve in the error 
floor region is determined by the minimal critical number. In 
[8], we proved that a column-weight-three LDPC code with 
Tanner graph of girth g > 10 always has a trapping set of size 
g/2 with critical number g/2 for the Gallager A algorithm. 
It is worth nothing that for codes with Tanner graphs of girth 
g = 6 and g = 8, girth alone cannot guarantee correction of 
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two and three errors, respectively. It can be easily shown that 
codes with girth six Tanner graphs can correct two errors if 
and only if the Tanner graph does not contain a codeword of 
weight four. For codes with Tanner graphs of girth eight, we 
established necessary and sufficient conditions to correct three 
errors [9]. Thus, with the results presented here, the problem 
of determining the slope of the FER curve in the error floor 
region for column-weigh-three codes under the Gallager A 
algorithm is now completely solved. 

The rest of the paper is organized as follows. In Section 
[TT1 we establish the notation, define the Gallager A algorithm 
and analyze the algorithm for the first k (<?/4 — 1 < k < g/4) 
iterations. In Section [TTTl we prove our main result and we 
conclude in Section [TV] with a few remarks. 



II. Preliminaries 



A. Notation 



Let C be an LDPC code with column weight three and 
length n. The Tanner graph G of C consists of two sets of 
nodes: the set of variable nodes V with \V\ = n and the set 
of check nodes C. The check nodes (variable nodes) connected 
to a variable node (check node) are referred to as its neighbors. 
An edge e is an unordered pair {v, c} of a variable node v 
and a check node c and is said to be incident on v and c. A 
directed edge e is an ordered pair (v, c) or (c, v) corresponding 
to the edge e = {v, c}. With a moderate abuse of notation, we 
denote directed edges by simple letters (without arrows) but 
specify the direction. The girth g is the length of the shortest 
cycle in G. For a given node u, the neighborhood of depth 
d, denoted by N£, is the induced subgraph consisting of all 
nodes reached and edges traversed by paths of length at most 
d starting from u (including u). The directed neighborhood of 
depth d of a directed edge e = (v, c) denoted by N^, is defined 
as the induced subgraph containing all edges and nodes on all 
paths ei, . . . , e<2 starting from v such that e\ ^ e (see [3] for 
definitions and notation). In a Tanner graph with girth g, we 
note that A/"„ is a tree when t < g/2 — 1. Also, if e\ — (v, c) 
and e 2 = (c,v), then A/" e \ f~l 7V| 2 = cp for i + j < g - 1, 
Let k denote the number of independent iterations as defined 
in [1]. The original value of a variable node is its value in 
the ttansmitted codeword. We say a variable node is good 
if its received value is equal to its original value and bad 
otherwise. A message is said to be correct if it is equal to the 
original value of the corresponding variable node and incorrect 
otherwise. In this paper, o denotes a good variable node, • 
denotes a bad variable node and □ denotes a check node. For 
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output symmetric channels (see [3]), without loss of generality, 
we can assume that the all zero codeword is transmitted. We 
make this assumption throughout the paper. Hence, a bad 
variable node has received value 1 and an incorrect message 
has a value of 1. A configuration of bad variable nodes is a 
subgraph in which the location of bad variables relative to each 
other is specified. A valid configuration C g is a configuration 
of at most g/2 — 1 bad variable nodes free of cycles of length 
less than g. The set of bad variable nodes in N£ is denoted 
by B{Mi) and |S(A/" e d )| is denoted by B(A/" e d ). The number 
of bad variable nodes at depth d in A/" e d is denoted by bf. 

B. Hard Decision Decoding Algorithms 

Gallager in [1] proposed two simple binary message pass- 
ing algorithms for decoding over the BSC; Gallager A and 
Gallager B. See [10] for a detailed description of the Gallager 
B algorithm. For column-weight-three codes, which are the 
main focus of this paper, these two algorithms are the same. 
Every round of message passing (iteration) starts with sending 
messages from variable nodes to check nodes (first half of the 
iteration) and ends by sending messages from check nodes 
to variable nodes (second half of the iteration). Let r, a 
binary n-tuple be the input to the decoder. Let u>j(v, c) denote 
the message passed by a variable node v to its neighboring 
check node c in j th iteration and Wj(c, v) denote the message 
passed by a check node c to its neighboring variable node 
v. Additionally, let 0Jj(v, : ) denote the set of all messages 
from v, u)j(v, : \c) denote the set of messages from v to 
all its neighbors except to c and u)j ( : , c) denote the set of 
all messages to c. Let \w{:,v) = m\ denote the number of 
incoming messages to v which are equal to m G {0, 1}. 
The terms u)j(: \v,c),Wj(c, : ),Wj(c, : \v),Wj(: ,v) and 
Wj ( : \c, v) are defined similarly. The Gallager A algorithm 
can then be defined as follows. 



wi(v,c) 
Uj(v,c) 

Wj{c,v) 



= r(v) 



if Wj-i(: \c,v) 
if Wj-i(: \c,v) 



= {1} 
= {0} 



X 



r(v), otherwise 
u)j(: \v, c) ) mod 2 



At the end of each iteration, an estimate of each variable 
node is made based on the incoming messages and possibly 
the received value. In this paper, we assume that the estimate 
of a variable node is taken to be the majority of the incoming 
messages (see [8] for details). The decoded word at the end of 
the j th iteration is denoted as r"', The decoder is run until a 
valid codeword is found or a maximum number of iterations 
M is reached, whichever is earlier. The output of the decoder 
is either a codeword or r^ M \ 

C. The first k iterations 

We begin with a lemma describing the messages passed by 
the Gallager A algorithm in a column- weight- three code. 

Lemma 1: (i) If v is a bad variable node, then we have 
wi(t>,:) = {1} and 



« u)j(v, :) = {1} if \zuj—i(:,v) = 1| > 2, i.e., v sends 
incorrect messages to all its neighbors if it receives two 
or more incorrect messages from its neighboring checks 
in the previous iteration. 

« u)j(v,: \c) = {1} and u)j(v,c) — if Wj-i(: \c,v) = 
{0} and zuj-i(c, v) — 1, i.e., v sends one correct message 
and two incorrect messages if it receives one incorrect 
message from its neighboring checks in the previous 
iteration. The correct message is sent along the edge on 
which the incorrect message is received. 

« u)j(v,:) = {0} if Wj-i(:,v) = {0}, i.e., v sends all 
correct messages if it receives all correct messages from 
its neighboring checks in the previous iteration. 

(ii) If v is a good variable node, then we have oj\(v, :) = {0} 
and 

• uij(v,:) = {0} if \wj-i(:,v) = 0| > 2, i.e., v sends 
all correct messages if it receives two or more correct 
messages from its neighboring checks in the previous 
iteration. 

• u>j(v,: \c) = {0} and u>j(v,c) — 1 if Wj—i(: \c,v) = 
{1} and Wj-i{c,v) — 0, i.e., v sends one incorrect 
message and two correct messages if it receives two 
incorrect messages from its neighboring checks in the 
previous iteration. The incorrect message is sent along 
the edge on which the correct message is received. 

• u)j(v,:) = {1}, if Wj-\(:,v) = {1}, i.e., v sends all 
incorrect messages if it receives all incorrect messages 
from its neighboring checks in the previous iteration. 

(iii) For a check node c, we have, 

• Wj(c,v) — Uj(v,c) (B 1, if \u)j(:,c) = 1| is odd, i.e., c 
sends incorrect messages along the edges on which it 
received correct messages and correct messages along 
the edges on which it received incorrect messages, if 
the total number of incoming incorrect messages from 
its neighboring variable nodes is odd. 



Wj{c,v) — LOj{v,c), if \u)j(:,c) 



1 is even, i.e., c 



sends incorrect messages along the edges on which it 
received incorrect messages and correct messages along 
the edges on which it received correct messages, if the 
total number of incoming incorrect messages from its 
neighboring variable nodes is even, 
(iv) A variable node is estimated incorrectly at the end of 
an iteration if it receives at least two incorrect messages. 

Proof: Follows from the description of the Gallager A 
algorithm. ■ 

Now let v be a variable node which sends an incorrect 
message along the edge e = (v,c) in the (k + l) th iteration. 
The message along e depends only on the variable nodes and 
check nodes in A/" e 2fe . Under the assumption that M^ k is a 
tree, the above observations provide a method to find all the 
possible configurations of bad variable nodes in N% . We have 
the following two cases: 

(a) v is a bad variable node: In this case, there must be 
at least one variable node in J\f£ which sends an incorrect 
message in the k th iteration. 

(b) v is a good variable node: In this case, there must be 
at least two variable nodes in A/? which send an incorrect 
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(a) 



(b) 



C g 
V 



A 



A 








(c) 

Fig. 1 . Possible configurations of at most 2k + 1 bad variable nodes in the neighborhood of a variable node v sending an incorrect message to check node 
c in the (k + l) th iteration for|(aJlfc = l,|(rj)lfc = 2 andRglfc = 3. 



message in the k iteration. 

This is repeated k times until we reach the first iteration, at 
which point only the nodes and edges in 7V 2fc would have been 
explored and all of these are guaranteed to be distinct as 7V 2fc 
is a tree. Since only bad variables send incorrect messages in 
the first iteration, we can calculate the number of bad variables 
in each configuration. Specifically, let v be a variable node 
which sends an incorrect message along the e = (v, c) in the 
second iteration. If v is a good variable node, then TV 2 must 
have at least two bad variable nodes. If v is bad, A/" 2 must 
have at least one bad variable node. Following this approach, 
we have Fig. |l(a)| Fig. |l(b)| and Fig. |l(c)| which show the 
possible configurations of bad variable nodes in VV 2fc so that 
v sends an incorrect message in the (k + l) th iteration, for 
k = 1 , k = 2 and k = 3, respectively. 



Remarks: (i) Fig.[T]shows configurations with at most 2fc+l 
bad variable nodes. 

(ii) We do not illustrate configurations in which a bad variable 
node receives two incorrect messages in the k th iteration, so 
that it sends an incorrect message in the (k + l) th iteration. 
However, all such configurations can be found by considering 
configurations involving good variable nodes and converting 
a good varaible node to a bad one. This increases the number 
of bad variable nodes in the condiguration. As will be seen 
later, such configurations are not relevant for establishing our 
main result. 

The above observations help establish bounds on i?(7V 2fc ), 
which we state in the following lemma. 



Lemma 2: (i) If v is 
incorrect message one = 



a bad variable node sending an 
(v, c) in the (k + l) th iteration and 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY, JULY 2008 



N 2k is a tree, then B(J\f 2k ) > k + 1. If B(N 2k ~ 2 ) = 1, i.e., 
bj = for d = 2, 4, . . . , 2(fc - 1), then B{N 2k ) > 2C C ~ 1 ) + 1. 
If B{N 2k ~ 2 ) = 2, then B{N 2k ) > 2^^ + 2. 

(ii) If v is a good variable node sending an incorrect message 
on e = (v, c) in the (k + l) th iteration and M 2k is a tree, 
then B(M 2k ) > 2k. If B(N 2k - 2 ) = 0, then B{Af 2k ) > 2 k . 
If B(7V 2fe - 2 ) = 1, then B{M 2k ) > 2^ k - 1 '> + 2^- 2 ~> + 1. If 
B{N 2k ~ 2 ) = 2, then B{M 2k ) > 2^-^ + 2. 

Proof: The proof is by induction on k. It is easy to verify 
the bounds for k = 2. Let the bounds be true for some k > 2. 
Let vq be a bad variable node sending an incorrect message 
one= (vq, c) in the (k + 2) th iteration. Further, assume that 
M 2k+2 is a tree. Then, J\Q has at least one check node ci 
which sends an incorrect message along the edge e\ = [c\, vq) 
in the (k + l) th iteration. This implies that M 2 has at least one 
variable node v 2 sending an incorrect message in the (k+l) th 
iteration along the edge e 2 — (t> 2 , C\). Since a path of length 
2 exists between i> an d v i> -^e 2 ^ Nl +2 - 

If V2 is a bad variable node, then B(Af 2k ) > k + 1 and 
consequently B(J\f 2k+2 ) > k + 2. If v 2 is a good variable 
node, then B{M 2k ) > 2k and consequently B(J\T 2k+2 ) > 
2k + I > k + 1. 

If 6f = for d = 2,4, ... , 2k, then v 2 is a good variable 
node such that B(N 2k ~ 2 ) = which implies that B(J\f 2k ) > 
2 k by the induction hypothesis. Hence, B(M 2k+2 ) > 2 k + 1. 

If B{N 2k ) — 2 then either (a) t> 2 is a bad variable node 
with b* 2 = for d = 2, 4, . . . , 2(fc - 1) which implies that 
B(J\f 2k ) > 2(' c ~ 1 ) + 1 by the induction hypothesis. Hence, 
B(N 2k+2 ) > 2 ( - k -V + 2, or (b) v 2 is a good variable node 
with B(M 2k - 2 ) = 1 which implies that B(N 2k ) > 2 ( - k -^ + 
2 (fc-2) + i by the induction hypothesis. Hence, B(Af 2k+2 ) > 
2 (fc-i) +2 (fc-2) +2 >2( fc - 1 )+2. 

By the principle of mathematical induction, the bounds are 
true for all k when vq is a bad variable node. The proofs are 
similar for the case when vq is a good variable node. ■ 

III. The Main Theorem 

In this section, we prove that a column-weight-three code 
with Tanner graph of girth g > 10 can correct g/2 — 1 errors in 
g/2 iterations of the Gallager A algorithm. The proof proceeds 
by finding, for a particular choice of k, all configurations of 
g/2 — 1 or less bad variable nodes which do not converge in 
k + 1 iterations and then prove that these configurations also 
converge in subsequent iterations. When g/2 is even, we use 
k = g/A - 1 (or g/2 - 1 = 2fc + 1) and when g/2 is odd, 
we use k = (g — 2)/4 (or g/2 — 1 = 2k). We deal with these 
cases separately. 

A. g/2 is even 

Let ^o be a variable node which receives two incorrect 
messages along the edges e\ ~ (c\,vo) and e 2 = (c 2 ,vo) 
at the end of (k + l) th iteration. This implies that N^ and 
iVg 2 each has a variable node, v\ and v\ respectively, that 
sends an incorrect message in the [k + l) th iteration to check 
nodes c\ and c 2 , respectively. Let e^ = (v 2 , c\), e± = (v 2 , cf ), 
e 5 = ( c i: ^2)' ar, d 66 = (c 2 ,i>|) (see Fig. |2(a)| for an 
illustration). All possible configurations of bad variable nodes 



«vi 



V 



(a) 



A 



V 



(b) 



{\h 



(O 



Fig. 2. Configurations of at most 7 bad variable nodes, free of cycles of 
length less than 16, which do not converge in 4 iterations. 



in M 2k and M 2k can be determined using the method outlined 
in Section IH-CI Since there exists a path of length 3 between 
v\ and c\, we have M l ei C A/]+ 3 . Also, A^ 3 n M"i t = <j> for 
i+j < .9-1 = 4fc+3. Therefore, 7V* 3 fW| 4 = (j) for i+j < 4k. 
This implies that A^ 2 3 fe and A^ 2 4 fc can have a common node only 
at depth 2k. The total number of bad variable nodes in M 2k U 
Af 2k , B(Af 2k L)Af 2k ), in any configuration is therefore lower 
boundedbyB(A^ 2 3 fe ~ 2 )+S(AA 2 4 fc " 2 )+max(& 2 3 fc ,6 2 J)orequiv- 
alently max (B{N 2k - 2 ) + B{N 2k ), B(Af 2k ) + B{M 2k - 2 )). 
We are interested only in the valid configurations, i.e., at most 
g/2 — 1 bad variable nodes, free from cycles of length less 
than g. We divide the discussion into three parts: (1) we find 
all the possible valid configurations for the case when g = 16; 
(2) we then proceed iteratively for g > 16; (3) We consider 
the case g = 12 separately as the arguments for g > 16 do 
not hold for this case. 

1) g — 16: Let v be a variable node which sends an 
incorrect message in the iteration k + 1 = g/4 = 4 along edge 
e = (v, c), given that there are at most seven bad variables 
and J\fJ is a tree. Fig. |l(c)| illustrates different configurations 
of bad variable nodes in J\f£, As remarked earlier, Fig. |l(c)| 
does not show configurations in which a bad variable node has 
to receive two incorrect messages in an iteration to send an 
incorrect message along the third edge in the next iteration. It 
can be seen in the proof of Theorem [2] that these cases do not 
arise in valid configurations. 

Let vo,V2,v 2 ,ei,e2,e3, e^ be defined as above with k = 3. 
Using the arguments outlined above (and the constraint that 
g = 16), all possible configurations such that B(J\f 2k UAf 2k ) < 
7 can be found. Fig. [2] shows all such possible configurations. 

2) g > 20: Let C g be a valid configuration in which 
there exists a variable node vq which receives two incorrect 
messages along the edges e\ = (c\,vq) and e 2 = (cf,i>o) at 
the end of (k + l) th iteration. This implies that N^ and Af£ 
each has a variable node, v\ and v\, respectively, that sends 
an incorrect message in the (k + l) th iteration. We have the 
following lemma. 

Lemma 3: v\ and v 2 are bad variable nodes. 

Proof: The proof is by contradiction. We know that the 
total number of bad variables in any configuration is lower 
bounded by 
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» 



k > 3. We have two cases. 



B^l k ),B(^) 



B{N 2 ^ 



'■)) and that 



(a) v\ and v\ are both good variable nodes: We first note 



that in any valid configuration, B(N t 



2fc-2\ 



> 2. Otherwise, 



we have B(J\f 2 
2( fc -!)+2( fe - 2 ) 
B{N£) > 2 k 



= 1, and from Lemma 2, B(N% ) > 
1 or, we have B(J\f 2k ~ 2 ) = 0, and 
1. Both cases are a contradiction 
f 1 bad variable nodes. Hence, 



p.k-2 

-1 > 2fcH 
2 > 2k- 
as we have at most 2fc 
B{M^~ 2 ) > 2. 

Now, B(N 2k ) > 2k, and hence we have B(7V e 2 3 fc UVV 2 4 fc ) > 
B Wei) + B (-^e3^ 2 ) > 2fc + 2, which is a contradiction. 

(b) v\ is a bad variable node and v% is a good variable node. 
The opposite case is identical. 

First we claim that in any valid configuration, S(A/^ 3 ) > 
2. Since v\ is a bad variable node, B(A/^ 2 ) ^ 0. Assume 
that B(N™- 2 ) = 1. Then B(A/? fc ) > 2C - 1 ) + 1. Again, 



(a) 




2 implies that B(Af 2k U Af 2 4 fc ) > 2^'^ + 



k > 3), which is a contradiction. Hence, Fig. 3. [(a)] Construction of C g _ 4 from C 9 ,[(b)l Construction of G g+4 from 

C g . 

2 ) > 2 and B{M 2k ) > 2k, implies that 



B{N 2 t 2 ) > 
3 > 2fc + 1 (as 

B(N 2 *- 2 ) > 2. 

Now, B(A4 2 3 fe - 
-B(A/" 2 3 fc U M 2k ) >2k + 2 which is a contradiction. 

Hence, v\ and u| are both bad variable nodes. 



We now have the following theorem: 

Theorem 1: If C g is a configuration which does not con- 
verge in (k + 1) iterations, then there exists a configuration 
Cg-4 which does not converge in k iterations. 

Proof: In the configuration C g , v\ and v 2 are bad variable 
nodes which send incorrect messages to check nodes c\ and 
c\, respectively, in the (k + \) th iteration. This implies that 
Ml and jVg each has a check node, c\ and c|, respectively, 
that sends an incorrect message in k th iteration to v\ and v 2 , 
respectively. Now consider a configuration C 9 _4 constructed 
from C g by removing the nodes v\ , v\ , cj, c 2 and the edges 
connecting them to their neighbors and introducing the edges 
(vq, dj) and (vo, c§) (see Fig. |3(b)) . If C g has at most 2fc + 1 
bad variable nodes and no cycles of length less than g, then 
Cg-4 has at most 2(fc — 1) + 1 bad variable nodes and no cycles 
of length less than g — 4. In C s _4 variable node vo receives 
two incorrect messages at the end of k iterations and hence 
Cg-4 is a valid configuration which does not converge in k 
iterations. ■ 

Theorem Q] gives a method to construct valid configurations 
of bad variable nodes for girth g from valid configurations for 
girth g + 4. Also, if C 1 and C 2 are two distinct valid config- 
urations, then the configurations C t 1 4 and C 2 4 constructed 
from Cg and C 2 respectively, are distinct. Hence, the number 
of valid configurations for girth g is greater than or equal to 
the number of valid configurations for girth g + 4. Note that 
the converse of Theorem Q] is not true in general. However, 
for 9 > 16, we will show in Theorem [2] that any configuration 
for girth g can be extended to a configuration for girth g + 4. 

Theorem 2: For g/2 even and k > 3, there are only 
three valid configurations which do not converge in (k + 1) 
iterations. 

Proof: For k = 3, we have g = 16 and there are only 
three valid configurations as given in Fig |2] So, for g > 16 
and g/2 even, there can be at most three valid configurations. 



(b) 





l\J>cL j 7 ^ f\AI 



(a) 



(b) 



(c) 



Fig. 4. Configurations of at most Ik + 1 bad variable nodes free of cycles 
of length less than 4fc + 4 which do not converge in (k + 1) iterations. 



Each valid configuration for g = 16, can be extended to a 
configuration C20 for g = 20 by the addition of two bad 
variable nodes v\ ew and v 2 ew in the following way. Remove 
the edges (vo,c{) and («o,c 2 ). Add bad variable nodes v\ ew 
and v 2 ew and check nodes c] lew and c 2 lew . Introduce the edges 

l^Oj c ne.w)i \ v 0yC n ew)' \ V new > C nemi' l"neio > C neu)/' \^'neu)i C l/ 

and (v 2 ^, cf ) (see Fig. |3(b)| for an illustration). It can be seen 
that C20 is a valid configuration for girth g = 20. In general, 
the configurations constructed using the above method from 
the valid configurations for g > 16 are valid configurations for 
5 + 4. Fig. [4] illustrates the three configurations for all k > 3. 

■ 
Remark: In all valid configurations C 9 with g > 16, no bad 
variable node receives two incorrect messages at the end of 
the (k + l) th iteration. 

Theorem 3: All valid configurations C g converge to a code- 
word in g/2 iterations. 

Proof: We prove the theorem for one configuration for 
g = 16 only. The proof is similar for other configurations. 
At the end of fourth iteration, let vq receive two incorrect 
messages (see Fig |2(a)[ >. It can be seen that there cannot exist 
another variable node (either good or bad) which receives two 
incorrect messages without violating the g = 16 constraint. 
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Also, vg, receives all correct messages and v\, t> 2 , v\, vf , v\, v\ 
receive one incorrect message each from cl,c^,cl,c^,c^,c^, 
respectively. In the fifth iteration, we have 

^5(^0, cf) = 1, 

w 8 (v,:\c) = {!}, {v,c) e{(4,4),(uf,c|), 

(v\, c\), (vl, cf), (Vg, 4)> ( W 6> 4)}) 
W5(v, c) = 0, otherwise. 

In the sixth iteration, we have 

W6(V0,C?) = 1, 

we(v,:\c) = {1}, (u,c)e{(u 2 \ 4), («!,<!),(< 4), 

u}q(v,c) — 0, otherwise. 
In the seventh iteration, we have, 

W7(fo,C?) = 1, 

wr(t»,:\c) = {!}, («,c) €{(«£, c£),(»2,c§)} 

o>7(u,c) = 0, otherwise. 

Finally in the eighth iteration, we have, 

aj 8 (vo,cl) = 1, 
u)s(v,c) — 0, otherwise 

At the end of eighth iteration, no variable node receives two 
incorrect messages and hence the decoder converges to a valid 
codeword. 

■ 

3) g = 12: In this case, k = 2 and the incoming messages 
at the end of the second iteration are independent. We need 
to prove that any code with Tanner graph with g = 12, can 
correct all error patterns of weight less than six. Let v be a 
variable node which sends an incorrect message in the third 
iteration along edge e = (v, c) given that there are at most 5 
bad variables and A/J is a tree. Fig. |l(c)| illustrates different 
configurations of bad variable nodes in A/", 4 . 

Fig. shows all possible configurations of five or less bad 
variable nodes which do not converge to a codeword at the end 
of three iterations. However, all the configurations converge to 
a codeword in six iterations. The proofs for configurations in 
Fig. EJa)-(h) are similar to the proof for configuration in Fig. 
|2(a)| and are omitted. Since, configuration (i) has only four 
bad variable nodes, a complete proof for convergence requires 
considering all possible locations of the fifth bad variable node, 
but other than that the structure of the proof is identical to 
that of the proof for the configuration in Fig. |2(a)| It is worth 
noting that in this case, there exist configurations in which 
a bad variable receives two incorrect messages at the end of 
the third iteration. However, all the configurations eventually 
converge to a codeword. 

B. g/2 is odd 

In this case, we have k — (g — 2)/4 and we need to prove 
that the code is capable of correcting all error patterns of 
weight g/2 — 1 = 2k or less. The methodology of the proof is 
similar to the proof in the case when g/2 is even. In this case, 



we have A/"J fl Af£ = <f> for i+j < 4fc — 2. This implies that 
A/" 2fe and A/" 2 4 fe can have a common node at depth 2k— 1. There- 
fore, in any configuration, B(A/2™ UJVj) is lower bounded 
by max (B(A/| 3 fc - 4 ) + B(A/£ fc ), £(A/" 2fe ) + £(A/|f- 4 )). The 
valid configurations in this case are the ones which satisfy 
B(A" 2 3 fc U A" e 2 4 fc ) < 2k. We again deal with g > 14 and g = 10 
separately. 

1) g > 14: 

Lemma 4: For g — 14, there is only one configuration of six 
bad variable nodes which does not converge in four iterations. 
Proof: Using arguments outlined above and the configu- 
rations in Fig. |l(b)| along with the constraint that g > 14, we 
conclude that there is only one configuration which does not 
converge in four iterations, which is shown in Fig. |6(a)| ■ 

Lemma 5: If C g with g > 14 is a valid configuration which 
does not converge in k + 1 iterations, then v\ and v\ are bad 
variable nodes 

Proof: Similar to the proof of Lemma [3] ■ 

Theorem 4: If C g is a valid configuration which does not 
converge in k + 1 iterations, then there exists a valid config- 
uration Cg-4 which does not converge in k iterations. 

Proof: Similar to the proof of Theorem [T] ■ 

Theorem 5: For k > 3, there is only one valid configuration 
which does not converge in k + 1 iterations. 

Proof: For k = 3, we have g — 14 and there is only one 
configuration. For k = 4, the number of valid configurations 
cannot be more than one. The valid configuration for g = 14, 
can be extended to a configuration for g = 18 (in the same 
manner as in Theorem |2). In general, the valid configuration 
for girth g can be extended to a valid configuration for girth 
g + 4. Fig. [6(b)! shows C g for all g > 14. ■ 

Theorem 6: The configuration C g converges to a codeword 
in g/2 iterations. 

Proof: Similar to the proof of Theorem [3] ■ 

2) g = 10: In this case, k — 2 and there are three 
configurations which do not converge at the end of the third 
iteration. Fig.|7]shows the three configurations. It can be shown 
that these configurations converge in five iterations. 

IV. Discussion 

In this paper, we have established a relation between the 
girth and error correction capability of column-weight-three 
LDPC codes. The result presented is the best possible bound 
as it is known that codes with girth g > 10 cannot be 
guaranteed to correct g/2 errors. While it is disappointing that 
the error correction capability grows only linearly in the girth 
for column-weight-three codes, the methodology of our proof 
can be applied to higher column-weight codes to (hopefully) 
obtain better results. 
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Fig. 5. Configurations of at most 5 variable nodes free of cycles of length less than 12 which do not converge in 3 iterations. 
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Fig. 6. nan Configuration of at most 6 bad variable nodes free of cycles of 
length less than 14 which does not converge in 4 iterations [(b)] Configuration 
of at most 2k bad variable nodes free of cycles of length less than Ak + 2 
which does not converge in k + 1 iterations. 
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Fig. 7. Configurations of at most 4 variable nodes free of cycles of length 
less than 10 which do not converge in 3 iterations. 



